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Mentoring has a mystique that only good can come from 
it, that at the worst, mentoring programs will not accomplish all 
that they could, but the youth served will at least be better for the 
experience. Both impact and process evaluations are needed to answer 
questions about the real benefits and any potential adverse effects 
of mentoring. The recent evaluation by the Manpower Demonstration 
Research Corporation of the national Career Beginnings program does 
indicate beneficial effects on educational aspirations and college 
attendance for average students who were not at very high risk. 
Project RAISE, in Baltimore (Maryland), a program to reduce the 
dropout rate of high-risk students, provides another example of 
program evaluation (conducted by McPartland and Nettles, 1991) that 
demonstrates that school attendance is a behavior that mentors can 
influence positively. Studies of the process of mentoring have 
suggested that the right kind of receptive youth can be benefitted by 
the right kind of motivated and trained mentors. However, research 
has generally not accounted for the impact of how a program is 
implemented. Research needs to investigate program implementation and 
the fit between the mentor and the youth. Good evaluations can help 
program managers understand and replicate this fit. Information 
collected about the mentor and the youth can highlight the 
relationship, participants' perceptions and assessments of the 
relationship, and obstacles and problems that stand in the way of a 
gratifying and useful relationship. Evaluation of mentoring programs 
needs to concentrate on the relationship between the mentor and the 
youth. (SLD) 
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WHY EVALUATE? 

As with many youth services, we know very little about the 
execution of nientoring progranr^ and the effect of nr^entoring 
on youth. Although we assume thai nrtentoring will benefit the 
youth — improve their sense of self, and overcome the 
damaging or limiting influences of their homes and conrv 
munities— we really do not know how, or how much, and 
what in their lives it will affect. Many parts of sodety are 
devetoping the capacity and will to provkle mentoring ser- 
vices to youth, but, paradoxically, the strong motivation to 
help nf^ be inhibiting us from seriously examining ttie help 
we are offering. 

Given the chance to spend money to evaluate a youtii pro- 
gram or to provide ukxb ss* vices, most program ad- 
ministrators would not choose the evaluation. They vAXJld 
rather use funds to reach more youth, recruit and train more 
mento<^, increase the front-line staff, or provide nrKxe ex- 
periences for the youtti. People who design and mn youth 
programs are service-oriented and identify strongly witi'i their 
dients. Many of tiiem may also be afraid that a rigorous 
evaluation of their program before it has had a chance to 
operate will jeopardize it. They frequently will support an 
evaluation only wtien tiiey feel it will demonstrate the 
program's success and help them get more support. 

Altiiough urxlerstandable, such ttiinking is short-sighted. 
Program administrators need to become more self-con- 
sdous and self-reflective about how well ttiey are providing 
mentoring help to their dients. Program funders need to be 
sure tiiat they are supporting programs goals that can 
be met. And, beyond ttie interest of any one program, sodal 
policy makers need to be able to compare ttie effects of 
various kinds of efforts to help youtti, like mentoring, educa- 
tion and training, and community service, and to determine 
ttie costs and benefits of each of ttiese interventions. 

Mentoring has a mystique ttiat only good can come from 
it tiiat nettling can go wrong, that at the worst ttie programs 
will not accomplish all tiiat they could, but ttiat ttie youtti will 
at least be better for ttie experience 
even if tiiey cannot say that it has 
markedly affected ttieir lives. But men- 
toring can be harmful. It can disilluskxi 
botti ttie mentor and the youtti who 
might not enter into such a relationship 
again. It can make youtti cynical about 
yet anottier program whkii promises 
more tiian it can deliver or is irrelevant 
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to their lives. It can fmstrate mentors who have difflculties in 
reaching ttie youtti, and feel abandoned by ttie youtti wtiom 
tfiey are volunteering to help and by ttie program staff who 
do not provide suffident support and guklance. And it can 
disillusion sodal planners if ttiey feel ttiat mentoring has 
been oversokl as a youtti development strategy. 

WHAT KINDS OF EVALUATIONS ARE NEEDED? 

Impact Evaluations 

Evaluations of ttie impact of mentoring can answer ques- 
tions like, "Do^ mentoring wori^?," 'Whkii kinds of mentor- 
ing (or models) are effective?," *What does it affect?," and 
*Whicb youth can most profit from it?" 

But answering these questions about mentoring can be 
problematic. Because many programs have been in opera- 
tion for only a year or two at most, evaluators of ttie out- 
comes of a mentoring program have to dedde wtiether ttie 
program has existed long enough to have measurable 
results. They also have to detemilne whether ttiey are look- 
ing for short-tenn results for ttie youtti, like higher test 
scores, better school attendance, or fewer anti-sodal acts, or 
for long-temi results, like sustained academic improvement 
and educational persistence overtime. 

Because evaluations of ttie impact of mentoring can com- 
pare youth who have received mentoring program services 
Viith tiiose who have not, collecting varioi^ kinds of data 
(e.g., grades and test scores) allows us to detemiine ttie 
amount, significance, and direction of the impact of a par- 
ticular program. Such evaluations can be used to ascertain 
whettier a particular program or nxxtel should continue to be 
supported and whettier fomial mentoring itself can sig- 
nificantiy affect the youtti it was designed to help. 

Process Evaluations 

To know more about ttie impact of mentoring on the youtti 
we need evaluations of ttie process of mentoring, but right 
now we have little more ttian impressionistic infonmation 
about how mentoring programs are 
implemented. Good process evaliia- 
tions can provide infomrvation for im- 
proving ttie program by changing 
some practices, for taking a different 
course, and even for changing how 
ttie program is being Implemented. 
Such evaluations do not directty ex- 
plain ttie effects of ttie program. 



either short-term or long-term; they reveal what is happening 
in the program that can contribute to these effects. 

Process evaluations can give mentoring professionals 
answers to such important questions as: 'Which youth 
should be mentored by the program?," "Which mentors will 
be effective and stay in the program?," *What l<ind of support 
should the program provide to the mentor and the youth?," 
"How should ttie program be managed and organized?" Be- 
hind all these operaticrKd concerns is a simple evaluation re- 
search question, although one difficult to answer: Which 
causes or processes working alone or working together 
bring into being a mentoring relationship that provides the 
necessary sodal and developmental opportunities for at-risk 
youth?' To answer this question we need good data cdlec- 
tion and record keeping witliin the project, partidpant or out- 
sider observation, or case histories. We paurficulariy need 
these data now because the current hoopla about what goes 
on in these programs, coming from dramatic anecdote, un- 
confirmed impressions, or casual observation, ^.oes nothing 
to help planners or administrators implement or defend their 
Ideas or progran^. 

WHAT HAVE WE LEARNED ABOUT THE IMPACT 
OF MENTORING? 

Two recent evaluations, of the national Career Beginnings 
program ^i\6 Project RAISE, suggest the directions of the im- 
pact of planned mentoring on youth. 

Career Beginnings 

The Manpower Demonstration Research Corporation con- 
ducted a national evaluation of the impact of Career Begin- 
nings, which was designed to assist len^idous" high school 
juniors from low-income families to complete high school 
and be admitted to a two- or four-year college, or, for the non- 
college-t)ound youth, to find jobs that develop their abilities 
(Cave and Quint, 1 990). In the study the partidpating youth 
were randomly assigned to the program to receive all the 
Career Beginnings services (experimentals), or to a control 
group wtTo would receive no formal program services but 
were free to get help in the school or community under 
natural conditions. The random assignment guaranteed that 
the two groups were comparable. 

The Career Beginnings program at each of the sites had 
some common features and provided some common ser- 
vices: collaboration among a local college or university (ac- 
ting as ttie program sponsor), tf^e public schools, and the 
business community; sumnrw jobs for the youth between 
their junior and senior years; wori^hops in the summer and 
during the year on matters related to applying for colfege; col- 
lege and career counseling; and mentors from the conv 
munity (not friends or family) to serve as rote models or to as- 
sist the youth in making future plans. Each site Implemented 
these services in its own way. The controls were likely ex- 
posed to many of ttiese services, but outside the Career 
Beginnings program. During their senior year of high school 
the controls received more support servfces than was an- 
tidpated by the program planners, although again the youth 



in tiie program received even more, but only by a small 
aiTKHjnt 

Both the program youth and tfie controls attended college 
at a higher rate than expected, given their somewhat disad- 
vantaged bac^kground, but, importantly, the Career Begin- 
nings program partidpants attended college at a greater rate 
and had higher educational aspirations. Moreover, the pro- 
gram youtti were more likely to begin college on schedule 
than the contrtois, altiiough the same percentage of both 
groups persisted in college during their freshnwi year. 

These findings are suggestive. Very important support 
services for able youth not likely to go on to college, 
wherever they iiet them, can make a difference to their col- 
lege plans and (persistence. In general, however, botti the 
Career Beginnings youtfi and the others were good can- 
didates for any ki'nd of program and for support services: al- 
though tiiey were only average students they had good 
school attendance records, no history of significant disdpli- 
nary problems, and, more generally, were personally 
motivated and committed (school service, part-time job, con- 
tributing to family income, and so forth). Cleariy, we can get 
a good return to an investment in youth such as these. 

We must not overtook ttiat Career Beginnings is not pure- 
ly a mentoring program, even though many label it as such; 
it offers a variety of related servtees to the youth, not unlike 
otfier college or career preparation programs which do not 
provide foo" al mentoring. A useful question we might ask 
then is, how much did ttie mentoring affect the youth, inde- 
pendent of other program servfces? Or a better question 
might be, how does mentoring beconr>e integrated and re- 
lated to other services to make a more comprehensive pro- 
gram effective? These questions can tell us more specifically 
about how to employ mentoring in services to youth. 

Project RAISE 

The goal of Project RAISE in Baltimore, Maryland, is to 
reduce the dropout rale of high-risk students, beginning in 
the middle school, with the help of adults from the conv 
munity acting as mentors or advocates. An evaluation of the 
effects of the program after two years of operation, con- 
ducted by McPartland and Netties (1991), found that conv 
pared witti a a)ntrol group not receiving Project RAISE ser- 
vices ttie program most strongly improved the students' 
attendance and repoil card grades in English, but not their 
promotion rates or grades on standardized tests. Moreover, 
the students still had attendarx» and academic perfomTance 
problems ttiat put them at risk for academic failure and drop- 
ping out of school. The results of the program do, however, 
suggest ttiat school attendance is a behavior mentors can 
easily influence, unlike promotions and grades, over which 
teachers have the greatest influence. 

Cleariy, we need evaluations of ttie impact and outcomes 
of mentoring if a particular community or ttie society at large 
ir to oor^tinue to invest In it These evaluations, however, sug- 
gest ttiat we must be willing to accept small, short-temi ac- 



complishments, and not insist on major changes In the youth 
served by the programs. 

WHAT HAVE WE LEARNED ABOUT THE PROCESS 
OF MENTORING? 

The Right Kind of Youth 

Flaxman and Ascher (1 992) in their study of a sample of 
mentoring programs found that, in their planning, programs 
can dearly differentiate the kinds of youth they want to 
SGrve--e.g., those who need some social support but who 
are not fundamentally at risk, or others with multiple sodal 
and psychological needs. But when it comes to implen)enta- 
tion, program devek>pers and managers do not always stick 
to the distinction. Moreover, the researchers also found that 
although almost all program sponsors have a dear idea of 
uie youth they want the program to serve, they leave the 
decision of who will actually partidpate to sonneone else. For 
school-based programs, tlMs means teachers and coun- 
s'^lorr in dose proximity to the students dedde who will profit 
from the program. And alttKKjgh most programs were 
designed for at-risk youth, "at-riskness" as a construct is 
often used idiosyncratically. 

The distinctfon between (a) the kinds of youth that the pro- 
gram sponsors and developers have aeated the program to 
serve, and (b) the youth the program is actually serving, is 
inr>portant. It is important for determining wtiat services to pro- 
vide, arxl how to provide them, and for aniving at reasonable 
expectations for the program's impact. And it is important for 
distinguishing those who can profit from a fairly limitad men- 
toring relatkxiship from those who need something else in 
addition to the relationship. 
The Right Kind of Adults to Be Mentors 

Flaxman and Ascher (1992) also found that most mentors 
are chosen because they are available, not always because 
they are right for the program. They vdunteer usually 
through a community organization or agency or business. 
They brir^ to the relationship their own intuitive styles of 
relating to youth. Most training is not designed to alter the 
mentor's intuitive styles. In programs for high-risk, poor, 
minority youth, mentors sometimes may even take a nKKBlis- 
tic stance or view their role as compensatofy because they 
are sodally distant from the youth they are tying to help; 
they do nol easily understand the worids of the youth, and 
so see them as cultural or environmental abstractfons rather 
than as indivkJuals. The mentors may also drop out or lose 
interest either because they commit time they do not have or 
because they are not gratified by the responses they receive 
for the help they offer. 

Mentors sometimes are also confused about what is ex- 
pected of them and take on responsibilities they cannot 
meet. Hamilton and Hamilton (1990) in their evaluation of 
the implementation of Unking Up, a nr^entoring program in 
New Yoric Stale, distinguish among four goals for the mentor- 
ing relattonship whk^i they view as level?; on a hierarchy: (1) 
building a relationship, (2) introdudng options to the youth, 
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(3) building the youth's character, and (4) developing com- 
petence in the youth. They found that the mentors who feit 
they had to build a relationship with the youth felt they were 
less successful than those wtx) concentrated on developing 
the youth's competence, and were the most self-critical. Men- 
tors who engaged in a conaete activity with the youth to 
build his or her competence felt most satisfied with the ex- 
perience. But as a group tt)e mentors felt they needed sup- 
port from the project staff, partk^ularty to know what to do in 
their time with the youth. 

After visits to a numl>er of mentoring programs nationally, 
Freedman (1991) found that mentoring is not just the venue 
of the outside vdunteer, that the pakJ front-line staff also as- 
sume mentoring rdes for the youth. They actually Interact 
with the youth roore than the mentors do, certainly in school- 
Lised programs wtiere teachers and counselors who are 
part of the project see the stislents daily. In other programs a 
paid youth worker Is frequently the unrelated adult to whom 
the chikJ and the family turn in an emergency or to solve a 
problem. In Career E)q?lorations, the forenjnner of Career 
Beginnings, the youth who were placed in summer jobs did 
not really distinguish an>ong their supervisors, the program 
staff, and their assigned mentors from the community as hel- 
pers or mentors. 
Implementing the Mentoring 

Most of what we call mentoring programs are really educa- 
tion and training efforts or youth programs with mentor-like 
activities and services, as is the case with Career Begin- 
nings, and so we must consider how the mariagement and 
organization of these activities and services affect the impact 
of the ''mentoring program/ For the youth in the Career 
Beginnings program the differences came about because of 
the execution of the program, not because of the features of 
the program. The program had the greatest impact on the 
youth where the Career Beginnings nf>odel was most strong- 
ly implemented and the servfces best delivered (Cave and 
Quint 1990). In Project RAISE ail the positive effects couW 
be linked to only three of the seven community sponsors 
(McPartland and Nettles, 1991). Until now research general- 
ly has not accounted for the Impact of how a program Is inv 
piemented on its outcome, and some people have come to 
feel that many programs with good designs have failed t)e- 
cause they do not have a servfce viskxi, a service delivery 
system, and a distinct identity, and ignore the problems of 
leadership and staffing (Hahn, 1992). And Freedman (1991), 
after scores of semhstruCtured interviews with those in- 
vdved with mentoring programs has conduded that nf>entor- 
ing dangerously lacks an infrastructure to sustain it, that it 
now subsists on fervor arxJ enthusiasm. 

HOW DO WE LEARN MORE ABOUT THE 
MENTORING RELATIONSHIP? 

What makes mentoring different from many other 
programs for youth is the nientoring relationship itself. If the 
essential servfee of a mentoring program is the mentoring, 
as distinct from education, training, enrichment, counseling, 
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and so forth, ttien it is the interaction of the nrtentor and the 
youth that needs to be nfK>st doseiy studied. Questionnaire 
studies alone do not help us enough to understand the true 
dynamics of ttie mentoring interaction because mentors and 
youth give unnatural and sodally desirable ar^wers to ques- 
tions, rather than respond intuitively. Methods lilce systematic 
or participant observation are better devices for under- 
standing the nrwitoring relationship. These relatively unstruc- 
tured devices provide a detailed and comprehensive descrip- 
tion of what is going on in a particular scene. Investigators 
generate and explain hypotiieses or assumptions. In tfiis 
way they give administrators and funders an explanation 
about what is going on in the relationship, which helps tiiem 
decide to continue or change the course of tfie mentoring. 

Some Particular Methods 

Evaluators can observe and record agreed-upon 
desirable behaviors in the relationship or analyze tiie written 
records of the mentors, youth, or program staff. They can 
develop a chectdist of desirable behaviors to obsen^e, or 
identify particular characteristics to analyze in Jtie writings of 
the participants in ttie program. The checklists sxplain ttie ex- 
ternal, visible behaviors of tine youth and tiie nrwitor; the con- 
tent analysis of their writings can be used for getting at inner 
experiences, beliefs, attitudes, and such psychological 
states as anxiety, affection, and hostility (Judd, Smith, and 
Kidder, 1991). 

investigators can also faithfully record wtiat they observe 
under more natural conditions without using checklists or 
coding schemes by observing the interaction as it takes 
place without any preconceptions about its character. How- 
ever, these investigators come to the scene witfi particular 
constructs for viewing it; for example, ttiey might assume 
that mentors and youtti want to establish a relationship but 
cannot do so easily because they are so socially distant The 
observers use ttiese lenses" to analyze recumng events, 
themes, and explanations in tfie scene, or to change lenses 
when what they observe suggests other perspectives (Judd, 
etal.). 

The Mentoring Fit 

A particulariy important but unacknowledged problem in 
mentoring prograjns is the *1it" between the mentor and the 
youth. Good evaluations can help program managers create 
this fit The evaluations can help them team myre about the 
mentor's individual characteristics and caretaking style, the 
experiences of the youth in tiie relationship, and the action of 
the relationship itself. They would especially need to help 
managers know more about the youth's experiences in the 
program. The youtii have more knowledge about tfieir past 
and present needs and desires and have a greater invest- 
ment in ttie servkie tiiey are receiving than the program staff, 
the funders, or even the mentors thennselves. 

We can loam more about tiie youth's experierwes by 
using a few simple strategies. Information can be c^^lected 
about the mentor and the youth at tlie saeening stage. 
During Uie program their interaction can be evaluated 
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tfirough open-ended interviews with the rT>entor and tfie 
youth togetiier and separately. This allows us to observe 
ti>eiY> in action in the relationship but also lets them establish 
tiieir own observatk>n and assessment of it The case on a 
particular relationship (and relationships in the program 
generally) can be thk*ened and enriched by conducting 
focus groups of mentors and youth nieeting togetiier and in 
separate groups as well. Thus, again, we can obsen/e the 
mentors and youtti acting togetiw as ttiey reflect on ttieir ex- 
periences as well as alone with their peers. These are ways 
of teaming about ttie effect of tfie mentor's and youtti's ex- 
pectations, desires, and perceptions of tiieir needs and tiie 
ways they relate to each otiier. This would illuminate the 
stumbling bkx^ and problems that stand in tiie way of a 
gratifying or useful relationship. And the relatiopiship is what 
mentoring is about. 

— EnwinFlaxman 
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